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OPTICAL CORRELATOR 



The present invention relates to an optical correlator 
and to a method of correlating. 

The correlation between two variables is a quantity 
indicating the closeness of the relationship between two 
functions. Where two functions can be precisely 
represented, the relation between them can be determined by 
an integral known as the correlation integral. 

Thus, correlation may be performed computationally, 
for example in the field of digital signal processing. 

In mathematical terms, for an arbitrary first function 
f{x) and an arbitrary second function g(x) , the correlation 
integral h{x) is set out in equation (1) : 

CO 

Kx)= jf(u)xg(x+u)du 

(1) 

It is convenient, when providing a measure of the 
similarity between two images, not to form the correlation 
integral by computation but instead to use Fourier optics. 

I 

The Fourier transform of the correlation integral is shown 
in equation (2) : 

D(h(x) }=F(s) X G*(a) (2) 



where 3?{h(x) }is the Fourier transform of {h(x)}. P(s) 
and G{s) are the Fourier transforms of f (x) and g(x) 
respectively and * indicates the complex conjugate. 



10 
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To explain the term "complex conjugate", a complex 
number expressed as x+jy (j is the square root of -1)/ has 
ar-compl-ex -<2eH-j-ugafee--g4ven7'-by--x---=-j-y . — - 

In the field of optics it is well known that a real 
(as opposed to virtual) image of the Fourier transform, of 
an input image is formed using a lens of positive optical 
power, (in other words a converging lens) at the back focal 
plane of the lens. 



It. is therefore possible to apply two or more images, 
typically two images, such as a reference image and a »scene 
image, side-by-side to a positive power lens and to form 
the Fourier transform of the two images at the back focal 

15 plane of the positive power lens.. The power of the joint 
transform of the two images is then sensed as the joint 
power spectrum. By analogy with the above discussion of 
correlation, if the Fourier transform of the reference and 
scene images is itself then Fourier transformed to provide 

20 a second Fourier transform, for example by application to a 
further positive power lens, then the second Fourier 
transform is indicative of the correlation between the two 
images. A device employing this .technique is the siibject 
of US Patent 5511019. 

25 

Image display devices are usually pixellated. Thus 
the reference and scene images which are displayed on the 
image display devices are discontinuous. Now, the 
mathematical analysis of pixellated systems becomes 
3 0 complicated; however, the correlation results obtained 

using optical Fourier transforms of pixellated images are 
still valid. 



r 



-3- 



A number of problems exist with optical correlators. 
One problem is that some types of image display device 
require an appreciable time to load an image. To mitigate 
5 this problem the state of the art currently favours the use 
of ferroelectric liquid crystal devices, which are 
relatively fast. 

Other problems relate to the size of correlators in 
10 which two successive Fourier optical systems are required 
to provide two successive Fourier transforms. 

The physical size has to some extent been addressed by 
earlier attempts to build correlators, such earlier 

15 attempts using the same Fourier optics for both 

transforming steps in a dual -pass system. For such devices 
the. Fourier transform of the reference and scene images is 
obtained by applying information to produce those images on 
a display device such as an SIM (spatial light modulator) 

20 as initial input data. After application to Fourier 

optics, the intensity of the Fourier . transform is sensed as 
first transform data. Then the initial input data is 
removed and the first transform data is sxabstituted for the 
initial input data. The first transform data produces an 
25 image applied to the Fourier optics, to produce the secbnd 
transform, and the intensity of the second transform is 
sensed to form the correlation data. 



30 



However, in spite of this double -use of the optics, 
the length of such a double -pass correlator is relatively 
large and there is an undesirable spatial separation 
between image display and image capture devices. The time 
to produce a valid correlation result includes the length 
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of time taken to write image data to the image production 
device, the length of time required for sensing the Fourier 

t£^sform-o±-1rhe--i-nput— i-mage-arnd^fehe— l^ng-t^^ 

conveying that Fourier transform information back to the 
5 image production device, followed by the length of time 
again to write that information to the image production 
device, and the length of time for the image sensing device 
to sense the second Fourier transformed result. Thus, one 
of the consequences of the spatial separation between the 

10 input image and the Fourier- transformed resultant image is 
that the length of time taken to provide a correlation 
result is extended. 

Ferroelectric liquid crystal devices are normally two- 
15 state devices, with both states, at least for phase devices 
• normally being actively- driven states. Thus instead of 
providing a stimulus in one state, and none in the other 
(as is suggested by logic values "1" and "0"), mutually- 
opposite stimuli correspond to the two states, .i.e. in 
20 reality and In any event, it is necessary to 

binarise the transform data before it can be applied to a 
two state SLM. This step can take an appreciable amoiint of 
time, and be a cause of slow correlation time. 

25 According to a first aspect of the present invention 

there is provided an optical correlator having an image 
production device, an image capture device and an optical 
device constructed and arranged to provide a Fourier 
transform of image information from the image production 

30 device at the image capture device, wherein the image 

production device and image capture device are disposed in 
a common plane. 



The common plane in some embodiments is the focal 
plane of a curved mirror. , In other embodiments the common 
plane may be the focal plane of a planar mirror with a 
5 positive power lens. 

By disposing the image production and capture devices 
locally to one another, the correlation speed of the • 
correlator is increased by comparison with correlators in • 
10 which the image production and capture devices are mutually 
remote. The physical size of a correlator having a folded 
architecture of this sort is less than the prior art 
correlators . 

15 The image production device and the image capture 

device may be integrated on a common substrate. 

By providing a common substrate, the operating 
conditions of the two devices can be made identical. 
20 Integration allows manufacturing costs to be minimised, and 
. handling and alignment issues to be addressed. 

In one family of embodiments, the image production 
device has plural image production elements, the image 
25 capture device has plural image capture elements and the 
image production elements and the image capture elements 
are within the image production elements. 



By forming the elements interspersed or intercalated, 
30 the optical system does not provide a spatial offset of the 
image to be captured with respect to the image provided by 
the image production device. It should be borne in mind 
that illumination of the image production device is 
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.10 



15 



20 



25 



30 



sxjLbstantially uniform and that where the image production 
and capture elements are interspersed, the information 

t:ontent--o£--ea-ptHia?ed— 1-ight'- is- f o»ned-~by— subt^aat±ng. Jihe 

uniform amount from the total incident light • 

In one of this family of embodiments, each image 
production element includes an image capture element. 

The image capture elements may be relatively small by 
comparison to the image production elements so that a 
regular array of image production elements each contains an 
image capture element . 

In another- family of embodiments, the image production 
device and the image capture device are spatially separate. 

In embodiments where the image production device and 
image capture device are spatially separate, special 
optical measures are taken to offset the resultant image 
from the optical system with respect to the image on the 
image production device. 

The correlator may comprise at least one positive 
power optical device arranged to receive light from the 
image' production device and to pass light back to the image 
capture device. 

The positive power optical device may comprise a 
curved mirror. 



Alternatively, the positive power optical device 
comprises a planar mirror and a positive power lens. 
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Instead of a mirror, a fibre array may be used to 
•fold back' the light to the image capture device. 

The image production device may comprise circuitry for 
applying reference image data to one part of the image 
production device, and circuitry for providing scene data 
to another distinct part of the image production device. 

In one family of embodiments, the image production 
device provides phase modulation of light in response to * 
displayed image data. In another family of embodiments the 
image production device provides amplitude modulation of 
light in response to displayed image data. 

The image production device may have two output levels 

only. 



The image production device may comprise a 
20 ferroelectric liquid crystal on silicon spatial light 
modulator (FLCOS SLM) . 

Alternatively, a nematic liquid crystal on silicon 
spatial light modulator may be used. 

25 

In yet another family of embodiments, a 
microelectromechanical systems (MEMS) modulator is used. 

According to a second aspect to the present invention 
30 there is provided a pixel lated image capture device for a 
joint transform correlator, the image capture device being 
constructed and arranged to provide . an electrical signal 
per pixel representative of the quantity of light received 
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at the pixel wherein the image capture device is integrated 
on a silicon substrate, and the integrated device further 
.^^^j^^g^.g_p^^.Q^.g^-jj.g-^^ 

compare the electrical signal of each pixel of the image 
5 capture device against a threshold, and to provide an 
output signal per pixel. 

The threshold may be formed from the electrical 
signals of at least one pixel adjoining the said pixel. 

10 

The image capture device may further comprise a 
pixel lated image production device, and the processing 
circuitry is constructed and arranged to provide each 
output signal per pixel to a respective pixel of the image 
15 production device. 

The image capture device may further comprise output 
circuitry for reading out lanprocessed information from each 
pixel . 

20 

According, to a third aspect to the present invention 
there is provided a method of correlating at least one 
input image with at least one reference image, the method 
comprising illuminating a representation of the or each 

25 input image and the or each reference image with coherent 
light to provide a first light beam; passing the first 
light beam to an optical device disposed to provide a 
second image at a plane, the second image being a Fourier 
transform of the or each input image and reference images; 

30 wherein the second image is formed co-planar with the 
representation of the or each input image and reference 
image . 
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According to a fourth aspect of the present invention 
there is provided an integrated circuit comprising a liquid 
crystal on silicon spatial light modulator and an image 
5 capture device, the spatial light modulator having an array 
of light modulating elements and the image capture device 
having an array of light capture elements, wherein each 
light capture element is arranged to provide an output 
representative of the light picked up by the respective 

10 capture element, the integrated circuit further having 

processing circuitirir for each capture element constructed 
and arranged to process the output of the said capture 
element together with the output of at least a respective 
one other capture element and to provide a first output 

15 from each capture element in response to such processing, 
the capture device further having output circuitry for 
outputting the unprocessed output of each capture element. 

Two embodiments of the invention will now be described 
20 with reference to the accompanying drawings in which :- 

Figure 1 shows a block schematic diagram of a first 
optical joint transform correlator embodying the present 
invention; 

Figure 2 shows a block schematic diagram of a second 
25 optical joint transform correlator embodying the present 
invention; 

Figure 3 shows a diagrammatic cross -sectional view 
through the image production and capture device of Figure 

30 Figure 4 shows cross-sections respectively through the 

circuitry level of the substrate, through the mirror and 
through the liquid crystal portions of the device of Figure 
3; 



r 



•10- 



Figure 5 shows a block schematic diagram of a part or 
an image production and capture device for use in the 

-inveneloir, -iTicoarporat-i-ng-proees-s-ing-aRd-oufeput- 4=1 rcultj^ 

Figure 6 shows a schematic diagram of processing 
5 circuitry of the device of Figure 3; and, 

Figure 7 shows a block schematic diagram of a known 
optical joint transform "correlator . 

Referring first to Figure 7 a prior art dual -pass 
10 optical correlator 100 operates as a binary phase-only 

correlator. The correlator 100 has a first SLM 101 and a 
second SLM 102 arranged side-by-side in a common plane VI- 
VI'. The correlator 100 has a first input line 104, which 
is connected for applying a respective input signal to the 
15 first SLM 101. A second input line 103 is connected to 
apply an input signal to the second SLM 101. Reference 
image information is supplied over the first input 104 to 
the first SLM 101; scene image data is applied over the 
second input 103 to the second SLM 102. 

20 

The SLMs 101,102 are transparent and are illuminated 
from one side, as shown in the diagram the left-hand side, 
by collimated laser light 110. The light passes into the 
SLMs 101, 102 and emerges as light 110a, modified by the 

25 phase shifts imparted by the SLMs 101,102. The SLMs 101, 
102 are pixellated and each pixel is binary; thus it is 
only able to provide a selected one of two possible phase 
shifts to light passing through that pixel. Hence the 
light 110a consists of spatially distinct beams of 

30 collimated light having a first or second phase shift with 
respect to the incident light 110. The beam 110a is 
incident on a Fourier converging iens 120, which has a 
screen 121 in its focal plane. The screen 121 displays the 
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joint Fourier transform of the reference and scene images. 
An image capture device 13 0 such as CCD camera 130 is 
disposed behind the screen 121 to capture the Fourier image 
data on the screen 121. The capture device 130 has an 
output 131 to a processing device 140. The processing 
device 140 has a first output 141, which forms a second 
input to the SLMs 101, 102. The processing device 140 also 
has a second output 142 . 



10 The joint Fourier transform data picked up by the 

capture device 130 is applied to the processor 140. The 
image on the screen 121 resulting from the application of 
the reference and scene images . at the lens 12 0 is an analog 
interference pattern. Information derived from this 
15 pattern is to be applied to the binary SLMs 101,102 for a 
second pass, and hence it is necessary to decide which of 
the binary levels is represented at each pixel of captured 
data. To do this, the processor 140 allots to each of the 
pixels a brightness value of 1 or 0 according to some pre- 
20 established criterion. The output 141 of the processor 140 
conveys the binary information to the SLMs 101, 102. There 
the information is sxibstituted for the reference and scene 
image information as new image data. Light 110 is then 
applied to the new image data displayed on the SLMs 101, 
25 102. Again the light is passed through the Fourier lens 
120 to be incident on the screen 121. The capture device 
130 picks up the. image data which now represents the 
correlation between the two original input images, namely 
the reference and scene images originally applied to the 
30 SLMs 101, 102. The correlation data typically consists of 
two non- central bright spots 180 degrees symmetrical about 
the centre and a central bright spot. The central bright 
spot is the zero-order, i.e. undiffracted content, of the 
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joint power spectrum, shown as and in equation 3 
below. For the purpose of determining the cross - 
correitcL-t±onr-of -iAe-H::-wO' o-rigin^^^^ - 
be regarded as unwanted- It may of course be useful in 
other respects. 

The data picked up by the capture device 130 is 
applied again to the processor 140 which processes the 
image to extract information from the non-central peaks, 
outputting this information over the second output 142 as 
the desired correlation data. 

Referring now to Figure 1, a joint ' transform 
correlator 1 receives laser light from an optical fibre 2 
launched into free- space so as to provide a divergent beam 
3 . The divergent beam 3 is incident upon a collimating 
lens 4 disposed so that its focal point is coincident with 
the end of the fibre 2. Other methods of launching 
coherent light may be substituted for the arrangement 
shown - 

the collimating lens 4 provides a parallel beam 5 
which is incident on a beamsplitter 6 here a polarising 
beamsplitter, although this is not essential. The 
polarising beamsplitter 6 is disposed to divert incident 
light via 90 degrees to provide an emergent beam of light 7 
by reflection towards an image production and capture 
device 8 having an image production portion 8a and an image 
capture portion 8b arranged in a common plane. A second, 
beam 70 passes through the beamsplitter 6 and emerges in 
line with the fibre 2. The image production and capture 
device 8 in this embodiment is a combined ferroelectric 
liquid crystal spatial light modulator (PLCSLM) 8a and CMOS 
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smart pixel sensor array 8b, further described herein with 
respect to Figures 3,4 and 5. Between the polarising 
beamsplitter 6 and the device 8 there is a half-wave plate 
9 which changes the direction of polarisation of light 7 to 
5 output light 7a which is incident on the image production 
and capture device 8 for alignment with the liquid crystal 
to bisect the liquid crystal axis for binary phase. 

The image production portion 8a is pixellated, and as 
10 will be later described with respect to Figure 2, has an 
optically transparent front electrode 204, In this 
embodiment, the front electrode 2 04 is substantially 
continuous across the whole of the image production and 
capture device 8. The front electrode 204 is disposed over 
15 a ferroelectric liquid crystal layer 203, which is in turn 
disposed over a reflective aluminium layer 2 02 • Data are 
provided to drive electrodes of the image production 
portion 8a, so as to cause the pixels of the image 
production portion to display a reference image r and a 
20 scene image s, the two images being side-by-side and 

provided in phase terms. That is to say, the data of a 
binary (black and white) image is formed into counterpart 
first and second values of phase shift. 

25 The image production and capture device 8 may 

alternatively be in line with the fibre 2, e.g. in the 
location marked 30, and receive the second emergent beam 70 
after passing through a half -wave plate. In a further 
embodiment, there are image production and capture devices 

30 8 in both locations. In such an embodiment, the laser 

light may have two wavelengths and filters be disposed in 
front of each image production and capture device 8. 
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The light 7a from the half -wave plate 9 passes into 

"tHe~ -spa:tl'^l~tightr-modui^^ -t-3?a^i-spa-a?eHrt 

electrode 204. The phase of the light 7a is changed by the 
5 in-plane tilt of the ferroelectric liquid crystal layer 203 
within the pixel of concern. The light 7a is reflected by 
the aluminium electrodes 202 and passes again through the 
liquid crystal layer 2 03 and through the transparent 
electrode 204 to emerge as exiting light 17. The exiting 

10 light 17 is shifted in phase with respect to the incident 
light 7a by either a first amount, or a second amoxant 
depending on the voltage between the front electrode 204 
and the aluminium electrodes 202. The exiting light 17 
passes again through the half -wave plate 9 and is incident 

15 on the polarising beamsplitter 6. A first portion 17a of 
the light 17 passes straight through the polarising 
beamsplitter 6 to emerge in line with the incident beam and 
a second portion 17b is reflected back towards the fibre 2. 
The light 17a is incident on the reflecting face of a 

20 concave curved mirror 10 which has a focal length ±2 and is 
located such that its focal plane is at the plane of the 
image production and capture device 8. Thus, collimated 
light 17a which is incident on the curved mirror 10 is 
reflected back as reflected light 17c to the image 

25 production and capture device 8 as a focussed image. The 
distribution of light 17c across the image production and 
capture device 8 is an interference pattern indicative of 
the Fourier transform of image data provided by the image 
production portion 8a., 



30 



The correlator 1 further includes a processing unit 20 
which has a first output 21 for loading into the pixellated 
ferroelectric_l_i^^ two images 
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that are disposed side by sided across the SLM, one image 
representative of the reference image and the other 
representative of the scene image which is to be correlated 
with the reference image. The processing unit 20 receives 
5 the reference and scene image data r,s at a first input 22. 
It also has a second input 23 for receiving data from the 
pixels of the image capture portion 8b, and a second output 
24 at which correlation data are made available. 

10 In the present embodiment the device 8 contains 

circuitry 500 (see Figure 6) for allotting binary values to 
the light levels received at the pixels of the image 
capture portion 8b, and for applying those binary values to 
the pixels of the image production portion Ba. The 

15 circuitry 500 in this embodiment consists of clocked and 
gated comparison circuitry. The comparison circuitry 500 
compares the amoTint of input light at each pixel with the 
averaged magnitude of light at the four nearest -neighbour 
pixels. The output 330 of the comparison circuitry 500 

20 provides a '1' if the light at the pixel is greater, and a 
' 0 ' if smaller than the averaged light magnitude of the 
nearest neighbour pixels. The circuitry output per pixel 
is thus said to be binarised. The binarised data is 
connected via a gating, circuit (not shown) to the 

25 corresponding pixel of the image production portion 8a of 
the device 8 . 

By forming the comparison circuitry 200 on-chip, the 
signal transfer times, and thus time delays, are reduced. 
30 By providing one comparator per pixel, the comparison 

operations can be carried out substantially simultaneously 
and in parallel. This is very time-efficient. 
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The image data from the binarised results is then 
• passed'^tttrougn-'The'^Fouri "^'d'^Che'-'THfTircJt-eil'~a^^ — 

collected data at the pixels of the image capture portion 
5 8b is read out. The data this time is not passed to the 
comparator circuitry 200 but instead is passed to the 
second input 23 of the processing unit 20. Read-out is 
typically by a capacitor transfer system similar to a BBD 
so that the input to the processing xinit 20 is bit-serial. 

10 

In this embodiment the ferroelectric liquid crystal 
SLM is a 256 X 256 pixel device, although other sizes and 
geometries are possible. 

15 Referring now to Figures 3 and 4a- c, the device 8 

consists of a silicon wafer 250 with a circuitry portion 
200 on its surface. On the circuitry portion 200 is an 
oxide layer 2 01 on its surface. On the oxide layer is the 
aluminium reflective electrode layer 202. This layer 202 

20 defines the pixels of the image production portion 8a. As 
shown in Figure 4b the aluminium electrodes 2 02 are 
siibstantially square but with a square 3 02 excised from the 
corresponding comer of each pixel. The excised square 302 
forms a window 210 through which access is available to the 

25 underlying substrate on which there is disposed a 

photodiode 220 and pixel drive electronics 221. Over the 
aluminium electrodes 202 there is disposed an alignment 
layer 205 and, over the alignment layer 2 05, there is 
disposed a licjuid crystal 203 which extends substantially 

3 0 across the entirety of the SLM. Above the liquid crystal 
layer 203 there is a second alignment layer 206 and on top 
of the second alignment layer 206 is a transparent 

electrode _204_. The transparent electrode may be ITO or any 
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other known transparent electrode material. A spin-on 
glass coating or other encapsulating or covering material 
(not shown) is disposed over the transparent electrode 
layer 204, 

5 

The circuitry portion 200 is n-type and has, in the 
region of the window 210, (which it will be understood form 
a regular array across the substrate) a p-dopant heavily 
implanted into it to form a shallow implanted region 211. 

10 A rear n+ region 212 is implanted in the window area 210 to 
act as the rear electrode of the photodiode. A front diode 
electrode 213 is implanted in the window adjacent the edge 
of the oxide 201 to form the anode of the diode. The rear 
electrode 212 which forms the cathode and the front 

15 electrode 213 are connected to circuitry (not shown) 

disposed within the circuitry portion 2 00, for example 
disposed under the aluminium electrodes 202 via metal or 
polysilicon conductors . 

20 The image capture device 8a, as discussed above, 

captures the joint power spectrum |R+S|^ of the two images. 
The joint power spectrum is defined by equation 3: 

\R^sf =R*S + S*R + R^ ^S"" 

25 where R is the Fourier transform of the reference 

image, S is the Fourier transform of the scene images to be 
correlated with the reference image. 

In this relation, the terms R*S and S*R form desired 
30 and symmetrical correlation terms that appear in the 

output. The terms R^ and relate to the zero-order output 
which appears as an undiffracted central bright spot. 




The processing unit 20 receives the -data from the 
p'ixeTs and genera^*esn::orr^Ta "data trom trial5^aCa'"Ey 
extracting the zero-order bright spot, and computing values 
5 from the brightness and the separation of the correlation 
peaks in the image data. 



Referring to Figure 4, a portion of an image 
production and capture device 8 comprises nine pixels Pll- 
10 P33 of image production elements and an array of nine image 
capture sensor devices S11-S33. As shown, and as described 
with respect to Figure 3, the capture devices are within a 
cut-out portion of the production devices P11-P33. 

15 Although in this embodiment the sensor devices S11-S33 

are interspersed within the production devices P11-P33, the 
same principles will apply if the image production device 
and the image capture device are separately disposed on the 
same substrate. 

20 

The present description relates to the image 
production device P22 and the image capture device S22 . It 
will be understood that similar circuitry will be provided 
for each and every other one of the pixels of the image 
25 production and capture device 8 which may have, as 
previously described, 64K. pixels. 

For the pixel P22, S22 there is provided a comparator 
circuit 500 having two inputs 503, 510, The first input 

30 503 is connectable via a switch 502 to the line 501 from 

the image capture sensor S22 . The second input 510 of the' 
comparator 500 is connected to the sensors Sll, S13, S31 

- - and S33, w hich are the neare st -n eig hb ou rin g pixels to the 
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pixel 322, P22. The connection to the second input 510 is 
via switches 511, 512, 513, 514. The switch 502 connected 
to line 501 may be switched over to an alternative 
connection in which the line 501 is connected to a charge 
5 transfer device 505 of which only a portion is shown. 

The output 520 of the comparator 500 is connected to 
the pixel P22 of the image production device. 

10 The comparator 500 is arranged to compare the 

potential at first input 503 with the average of the 
potentials at the sensors Sll, S13, S31 and S33 . To do 
this, the switches 511-514 are closed and the comparator 
then provides a logical one output at the output 52 0 if the 

15 first input 503 is above one quarter the potential at the 
second input 510. Thus, provided the light input at the 
capture device S22 is greater than the average of the light 
at the capture devices Sll, S13, S31 and S3 3 then the 
output 520 will be at logical one. In all other conditions 

20 the output 520 will be at logic zero. Comparators may be 
• provided which operate using current or which operate using 
voltage, as will be described with respects to Figure 6.. 

In use therefpre when the first Fourier transform has 
25 been formed on the image production and capture device 8, 
the connection of the switch 502 will be as shown. The 
result is that the comparator 50 0 which is on the same 
substrate as the other components, will provide an output 
directly to the image production pixel P22 and all of the 
3 0 comparator circuits for each pixel will perform the same 
(non-destructive) comparison. 
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Once the first Fourier transform has been formed and 
the binarised data provided to the image production pixels, 

UKeri^'Ke~^img^e~^a^tiix^ 

spectrum, which is required to provide the correlation 
5 result. The correlation results are processed off chip and 
to that end the switch 502 is switched to its second 
position where it connects to the input line 504 to the 
charge transfer device 505. The charge transfer device has 
two clock inputs 506, 507 and operates in a form analogous 

10 to a bucket brigade device so that once a capacitor 520, 
521 is charged up to the potential provided by an 
associated capture device S22, suitable clock pulses 
provided to the clock terminals 506, 507 cause the 
associated transistors 53 0, 531 to clock-out a series of 

15 analogue voltages to the output terminal 508. The analogue 
voltages correspond to the sensors arranged in a row of the 
image production and capture device 8. After output ting 
the bit-serial voltages, these are processed as required to 
provide the relevant information. 

20 

Referring now to Figure 6, -a comparator circuit 500 
compares the output voltage from a photodiode 310 of a 
pixel with the corresponding output voltages of the four 
nearest pixels,, such voltages being supplied to four input 
25 nodes 301-304 of the circuit 500. The comparator 500 is a 
clocked device and has six clock inputs 320-324. The 
comparator circuit 500' has an output node 330. The 
structure of the comparator 500 will now be described. 



30 
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of the first nFET 350 is connected to a positive supply 306 
via the drain-source path of a first pFET 353 and the drain 
of the second nFET 351 is connected to the positive supply 
3 06 via the drain-source path of a second pFET 354. The 
5 first nFET is connected to a first line 331 via a 

transmission gate PET 355 controlled at it gate via the 
second clock input 321. The first input line 331 is 
connected to the positive supply 306 via a first p-type 
pre-charge FET 356 and to the negative supply 306 via four 
10 quarter-size n-type pull-dovm PETs 357-360. The quarter 

size n-type pull-down FETs each receives at its gate one of 
the neighbouring pixel inputs 301-304. The second n-type 
FET 351 is connected to a second input line 332 via a 
transmission gate FET 361 whose control electrode is 
15 provided by the third clock input 323 .' The second input 
line 332 is connected to the positive supply 306 via a 
second- p-type pull-up FET 362 whose gate is connected to 
the first clock input 320. The second input line 332 is 
connected to the reference 305 via a fifth pull-down FET 
20 363 of unit size, the gate of the fifth pull-down FET 363 
being connected to the photodiode 310. 

The operation of the comparator 500 will now be 
described. 

25 

Prior to any sensing operation, the clock inputs 320- 
323 are taken low so as to turn off the transmission gates 
355 and 361 and to turn on the pre-charge transistors 356, 
362. The .result is that the capacitance of the lines 331 
30 and 332 are pre-charged towards the positive supply 

potential. As the pull-up FET 356, 362 are of identical 
size and provided the capacitance of the lines 331, 332 are 
the same, the same amount of charge will be stored on the 
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two lines. Measures may be needed to ensure that the 
capacitances of the two lines 331, 332 are the same. 

During this pre-charge interval, the photodiode 310 
5 and the photodiodes of the nearest neighbouring pixels are 
unilluminated and, as a result, the transistors 357-60 and 
363 remain off. 

At a given time instant the clock inputs 320 are taken 

10 high, thus turning off the pull-up transistors 356, 362. 
At this time illumination is applied to the photodiode 310 
and the photodiodes of the neighbouring pixels so that the 
line 331 and the line 332 are pulled down towards the 
reference potential 305. If all of the photodiodes 

15 receives the same amount of illumination, lines 331 and 332 
will drop at the same rate. This is because the 
transistors 357-360 are one quarter the size of transistor 
363. However, if the light applied to photodiode 310 is 
greater than the average of the light applied to the 

20 photodiodes connected to teDrminals 3 01-3 04, then the line 
332 will be pulled down more rapidly than the line 331. 
After a given time has elapsed, the clock voltages applied 
to nodes 321 and 323 are taken high at the same time as the 
clock voltage applied to nodes 324 and 322. This has the 

25 effect of connecting the lines 331 and 332 to the gates of 
transistors 350 and 351. As the common source electrodes 
of the transistors 3 50 and 351 are taken towards the 
negative supply by the action of transistor 352, one of the 
two transistors 350 and 351 turns on and the other turns 

30 off, according to the respective gate voltages applied. As 
a result, if the second line 332 'is at a lower potential 
than the first line 331, then the transistor 350 will turn 
on and provide a low potential at output node 330. If 
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instead the first output line 331 is at a lower potential 
than the second line 332, then the transistor 350 remains 
off and the transistor 351 turns on. The result is that 
the output node 330 remains at the logic high state. 

5 

An alternative correlator 500 is shown in Figure 2. 
Here, the image production and capture device 8 of Figure 1 
is replaced by an integrated circuit 108 which has an FLC 
SLM portion 107 and a spatially separate image capture 
10 portion 106. The image capture portion 106 and the image 
production portion 107 are disposed on the same face of the 
device 108. The image capture portion 106 is disposed 
beyond the image production portion 107 and to the side of 
it. The curved mirror 10 is tilted off the axis of the 
15 beamsplitter 6 so that the resulting Fourier Transform is 
produced at the image capture portion 106. This allows the 
FLCSLM and CMOS sensor to be separate but integrated on the 
same substrate. It is alternatively possible for the PLC 
SLM 107 and the sensor 106 to be discrete Units . 



20 



Separating the FLC SLM 107 and the sensor 106 
decreases the complexity. The CMOS sensor 106 contains 
smart pixel technology to perform the binarisation process 
of the captured joint power spectrum. 



25 



In the foregoing example, the nearest -neighbour 
thresholding has been described as comparison with the four 
nearest-neighbour pixels. It is also possible to use other 
thresholding, such as comparison with the eight surrounding 
30 pixels. 
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Embodiments of the present invention have been 
described with particular reference to the examples 

-i'lius tr afced-: ^Howev^r-/ — art— wil-l~be- -app3?eC'ia-fe-ed— fefeat 

variations and modifications may be made to the examples 
described within the scope of the present invention 



Claims 



1- An optical correlator having an image production 
device, an image capture device and an optical device 
constructed and arranged to provide a Fourier transform of 
image information on the image production device at the 
image capture device, wherein the image production device 
and image capture device are disposed in a common plane. 

2. An optical correlator according to claim 1, wherein 
the image production device and the image capture device 
are integrated on a common substrate. 

3. An optical correlator according to claim 1 or 2, 
wherein the image production device has plural image 
production elements, the image capture device has plural 
image capture elements and the image capture elements are 
interspersed with the image production elements. 

4. An optical correlator according to claim 1 or 2, 
wherein the image production device has plural image 
production elements, the image capture device has plural 
image capture elements and each image production element 
includes an image capture element. 

5. An optical correlator according tp claim 1 or 2, 
wherein the image production device and the image capture 
device are spatially separate. 

6. An optical correlator according to any preceding 
claim, wherein the optical device comprises at least one 
positive power optical device arranged to receive light 
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from the image production device and to pass light back to 
the image capture device. 



7. An optical correlator according to claim 6, wherein 
5 the positive power optical device comprises a curbed 

mirror . 

8. An optical correlator according to claim 6, wherein 
the positive power optical device comprises a planar mirror 

10 and a positive power lens. 

9. An optical correlator according to any preceding 
claim, having circuitry for applying reference image data 
to one part of the image production device, and circuitry 

15 for providing scene data to another distinct part of the 
image production device. 

10. An optical correlator according to any preceding 
claim, wherein the image production device is operable to 

2 0 provide phase modulation of incident light according to 
applied image data. 

11. An optical correlator according to claim 10, wherein 
the image production device has two output levels only. 

25 

12 . An optical correlator according to any preceding 
claim, wherein the image production device comprises a 
ferroelectric liquid crystal on silicon spatial light 
modulator. 

30 

13 . An optical correlator according to any one of claims 1 
to 12 , wherein the image production device comprises one 
from the group comprising a nematic liquid crystal on 



silicon spatial light modulator, a pi-cell spatial light 
modulator and a microelectromechanical systems (MEMS) 
spatial light modulator. 

14- A pixellated image capture device for a joint 
transform correlator, the capture device being constructed 
and arranged to provide an electrical signal per pixel 
representative of the quantity of light received at the 
pixel wherein the image capture device is integrated on a 
silicon substrate, and the integrated device further 
comprises processing circuitry constructed and arranged to 
compare the electrical signal of each pixel of the image 
capture device against a threshold, and to provide an 
output signal per pixel in accordance with the comparison 
result - 

15. A pixellated image capture device according to claim 
14, wherein the threshold is foirmed from the electrical 
signals of at least one pixel adjoining the said pixel. 

16. A pixellated image capture device according to claim 
14 or 15, comprising a pixellated image production device, 
wherein the processing circuitry is constructed and 
arranged to provide each output signal per pixel to a 
respective pixel of the image production device. 

17. A pixellated image capture device according to claim 
16, having output circuitry for reading out unprocessed 
information from each pixel of the image capture device. 

18. A pixellated image capture device according to claim 
16 or 17, wherein the pixellated image production device is 
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integrated on this sa.me substuTcitc as th6 ima^c captmiTQ 
device . 



19. A method of correlating at least one input image with 
at least one reference image, the method comprising: - 

illuminating a representation of the or each input 
image and the or each reference image with coherent light 
to provide a first light beam; and, 

passing the first light beam to an optical device 
disposed to provide a second image at a plane, the second 
image being a Fourier transform of the or each input image 
and reference images-, 

wherein the second image is formed co-planar with the 
representation of the or each input image and reference 
image . 

20. An integrated circuit comprising a liquid crystal on 
silicon spatial light modulator and an image capture 
device, the spatial light modulator having an array of 
light modulating elements and the image capture device 
having an array of light capture elements, wherein each 
light capture element is arranged to provide an output 
representative of the light picked up by the respective 
capture element, the integrated circuit further having 
processing circuitry for each capture element constructed 
and arranged to process the output of the' said capture 
element together with the output of at least a respective 
one other capture element and to provide a first output 
from each capture element in response to such processing, 
the capture array further having output circuitry for 
outputting the unprocessed output of each capture element. 
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